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Abstract 



The notion of arc consistency plays a central role in constraint satisfac- 
tion. It is known since [19, 4, 5] that the notion of local consistency can be 
extended to constraint optimisation problems defined by soft constraint 
frameworks based on an idempotent cost combination operator. This ex- 
cludes non idempotent operators such as + which define problems which 
are very important in practical applications such as M AX-CSP, where the 
aim is to minimize the number of violated constraints. 

In this paper, we show that using a weak additional axiom satisfied by 
most existing soft constraints proposals, it is possible to define a notion 
of soft arc consistency that extends the classical notion of arc consistency 
and this even in the case of non idempotent cost combination operators. 
A polynomial time algorithm for enforcing this soft arc consistency exists 
and its space and time complexities are identical to that of enforcing 
arc consistency in CSPs when the cost combination operator is strictly 
monotonic (for example Max-CSP). 

A directional version of arc consistency, first introduced in [6] is poten- 
tially even stronger than the non-directional version, since it allows non 
local propagation of penalties. We demonstrate the utility of directional 
arc consistency by showing that it not only solves soft constraint problems 
on trees, but that it also implies a form of local optimality, which we call 
arc irreducibility. 

Introduction 

Compared to other combinatorial optimisation frameworks, the CSP framework 
is essentially characterised by the ubiquitous use of so-called local consistency 
properties and enforcing algorithms among which arc consistency is certainly 
preeminent. 

The notion of local consistency can be characterised by a set of desirable 
properties: 

• local consistency is a relaxation of consistency, which means that for any 
consistent CSP there is an equivalent non empty locally consistent CSP. 

• this equivalent locally consistent CSP, which is unique, can be found in 
polynomial time by so-called enforcing or filtering algorithms. 

Several papers have tried to extend the classical notion of arc consistency to 
weighted constraint frameworks. In such frameworks, the aim is to find an 
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assignment that minimises combined violations. The first work in this direction 
is probably [15] which defined arc consistency filtering for conjunctive (max-min) 
fuzzy CSP. 

This extension was rather straightforward and one might be tempted to think 
that this would be the case for other frameworks such as Max-CSP, introduced 
in [20, 9] , where the aim is to find an assignment which minimises the (weighted) 
number of violated constraints. This turned out not to be the case. Later works 
tried to extend arc consistency in a systematic way using axiomatic frameworks 
to characterise the properties of the operator used to combine violations: 

• the Semi- Ring CSP framework was introduced in [4, 5]. In this work, the 
extension of arc consistency enforcing is induced by a generalisation of 
the fundamental relational operators such as projection, intersection and 
join. The essential conclusion of this work is that extended arc consistency 
works as long as the operator used to combine violations is idempotent. 
This includes the case of conjunctive fuzzy CSP (in which we try to min- 
imise the violation of the most violated constraint) and also some other 
cases with partial orders. For Max-CSP and other related cases, the 
algorithm may not terminate and may also provide non equivalent CSPs. 

• the Valued CSP framework was introduced in [19]. Here, the extension 
of the arc consistency property is essentially based on the notion of re- 
laxation. The same conclusion as in the Semi-Ring CSP framework was 
reached for idempotent operators. For other frameworks such as Max- 
CSP, it was shown that the problem of checking the extended arc consis- 
tency property defines an NP-complete problem. 

Parallel to these tentative extensions of arc consistency, other research such 
as [21, 1, 13, 12] tried to provide improved lower bounds for Max-CSP. The 
idea of extending arc consistency was abandoned in order to simply provide the 
most important service, i.e. the ability to detect that a CSP has no solution 
whose cost is below a given threshold. 

Globally, each of these proposals violates some of the desirable properties of 
local consistency. In this paper we show that it is possible, by the addition to the 
Valued CSP framework of a single axiom, to define an extended arc consistency 
notion that has all the desirable properties of classical arc consistency except for 
the uniqueness of the arc consistency closure. It has also the pleasant property 
that in the idempotent operator cases, it reduces to existing working definitions 
and uniqueness is recovered. 

It has been shown [18] that a lower bound can easily be built from any of 
the arc consistency closures and that this lower bound generalises and improves 
upon existing lower bounds [21, 1, 13, 12]. In this paper, we also consider a 
directional version of arc consistency that improves lower bounds by propagating 
partial inconsistencies and not only value deletions as [13, 12]. In fact, we show 
that directional arc consistency, first defined in [6], defines a locally optimal 
lower bound. 

1 Notations and definitions 

A constraint satisfaction problem (CSP) is a triple (X,D,C). X is a set of n 
variables X = {1, . . . , n}. Each variable i e X has a domain of values di e D 
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and can be assigned any value a £ 4, also noted (i,a). d will denote the 
cardinality of the largest domain of a CSP. C is a set of constraints. Each 
constraint cp G C is defined over a set of variables PCX (called the scope of 
the constraint) by a subset of the Cartesian product HieP which defines all 
consistent tuples of values. The cardinality \P\ is the arity of the constraint cp. 
r will denote the largest arity of a CSP. We assume, without loss of generality, 
that at most one constraint is defined over a given set of variables. The set C is 
partitioned into two sets C = C 1 U C + where C 1 contains all unary constraints. 
For simplification, the unary constraint on variable i will be denoted Cj , binary 
constraints being denoted Cjj . e = C' + | will denote the number of non unary 
constraints in a CSP. If J C X is a set of variables, then £(J) denotes the set of 
all possible labellings for J i.e., the Cartesian product Y\ ieJ di of the domains 
of the variables in J. The projection of a tuple of values t onto a set of variables 
V C X is denoted by t\y. A tuple of values t satisfies a constraint cp if t\p G cp. 
Finally, a tuple of values over X is a solution iff it satisfies all the constraints 
in C. 

2 Valued CSP 

Valued CSP (or VCSP) were initially introduced in [19]. A valued CSP is 
obtained by associating a valuation with each constraint. The set E of all 
possible valuations is assumed to be totally ordered and its maximum element is 
used to represent total inconsistency. When a tuple violates a set of constraints, 
its valuation is computed by combining the valuations of all violated constraints 
using an aggregation operator, denoted by ffi. This operator must satisfy a set 
of properties that are captured by a set of axioms defining a so-called valuation 
structure. 

Definition 2.1 A valuation structure is defined as a tuple (E, ©, )p) such that: 

• E is a set, whose elements are called valuations, which is totally ordered 
by )p, with a maximum element denoted by T and a minimum element 
denoted by _L; 

• E is closed under a commutative, associative binary operation © that sat- 
isfies: 

- Identity: Va G E, a © _L = a; 

- Monotonicity: Va, f3,jeE,(a^f3)^ ((a © 7) ^ ((3 © 7)); 

- Absorbing element: Va G E, (a © T) = T. 

When E is restricted to [0, 1], this structure of a totally ordered commutative 
monoid with a monotonic operator is also known in uncertain reasoning, as a 
triangular co-norm [7]. 

It is now possible to define valued CSPs. Note that, for the sake of generality, 
rather than considering that a valuation is associated with each constraint, 
as in [19], we consider that a valuation is associated with each tuple of each 
constraint. As observed in [3], the two approaches are essentially equivalent. 
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Definition 2.2 A valued CSP is a tuple (X,D 7 C,S) where X is a set of n 
variables X = {l,...,n}, each variable i G X has a domain of possible values 
di G D. C = C 1 U C + is a set of constraints and S = (E, ©, >p) is a valuation 
structure. Each constraint cp G C is defined over a set of variables P C X as 
a function cp : Y\ ieP di — > E. 

An assignment t of values to some variables J <Z X can be simply evalu- 
ated by combining, for all assigned constraints c P (i.e., such that P C J), the 
valuations of the projection of the tuple t on P: 

Definition 2.3 In a VCSP V = (X,D,C,S), the valuation of an assignment 
t to a set of variables J C X is defined by: 

Vv(t)= [city)] 

cpEC^PCJ 

The problem usually considered is to find a complete assignment with a min- 
imum valuation. Globally, the semantics of a VCSP is defined by the valuations 
V(t) of assignments t to X. 

The choice of axioms is quite natural and is usual in the field of uncertain 
reasoning. The ordered set E simply allows us to express different degrees of 
constraint violation. The commutativity and associativity guarantee that the 
valuation of an assignment is independent of the order in which valuations are 
combined. The monotonicity of © guarantees that assignment valuations can- 
not decrease when constraint violations increase. For a more detailed analysis 
and justification of the VCSP axioms, we invite the reader to consult [19, 12] 
which also emphasise the difference between idempotent and strictly monotonic 
aggregation operators ©. 

Definition 2.4 An operator © is idempotent if Va G E,(a © a) — a. It is 
strictly monotonic if Ma, (3, 7 G E, (a >~ (3) A (7 7^ T) => (a © 7) >- (f3 © 7) 

As shown in [19], these two properties are incompatible as soon as \E\ > 2. 
The only valuation structures with an idempotent operator correspond to clas- 
sical and possibilistic CSP [16] (min-max dual to the conjunctive fuzzy CSP 
framework) which use © = max as the aggregation operator. Other soft CSP 
frameworks such as Max-CSP, lexicographic CSP or probabilistic CSP use a 
strictly monotonic operator. 

Arc consistency enforcing must yield an equivalent problem, the so-called 
arc-consistency closure. Several notions of equivalence were introduced in [19, 
12] that enabled us to compare pairs of VCSP with different valuations structure. 
In this paper, the notion of equivalence will only be used to compare pairs of 
VCSP with the same valuation structure and can therefore be simplified and 
strengthened. 

Definition 2.5 Two VCSP V = {X, D, C, S) and V = (X, D, C, S) are equiv- 
alent iff for all complete assignment t to X, we have: 

Vv(t) = V v >(t) 
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3 Fair valuation structures 



We start with an introductory example. In the remainder of the paper, in 
order to illustrate the notions introduced on concrete examples, wc will consider 
binary weighted Max-CSPs which correspond to valued CSPs using the strictly 
monotonic valuation structure (N U {oo}, +, >}. To describe such problems, we 
use an undirected graph representation where vertices represent values. For all 
pairs of variables i,j G X such that € C, for all values a G d{, b G dj such 
that Cij(a,b) ^ _L = 0, an edge connect the values (i,a) and (j, 6). The weight 
of this edge is set to Cij(a,b). Unary constraints are represented by weights 
associated with vertices, weights equal to being omitted. 

Let us consider the weighted Max-CSP in figure 1(a). It has two vari- 
ables numbered 1 and 2, each with two values a and b together with a sin- 
gle constraint. The constraint forbids pair ((1, 6), (2, b)) with cost 1 and for- 
bids pairs ((1, a), (2, a)) and ((1, b), (2, a)) completely (with cost oo). The pair 
((l,a), (2,6)) is completely authorised and the corresponding edge is therefore 
omitted. 
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Figure 1: Four equivalent instances of Max-CSP 



If we assign the value b to variable 1, it is known for sure that a cost of 
1 must be paid since all extensions of (1,6) to variable 2 incur a cost of at 
least 1. Projecting this minimum cost down from C12 would make this explicit 
and induce a unary constraint on 1 that forbids (1,6) with cost 1. However 
if we simply add this constraint to the Max-CSP, as was proposed in [4] for 
problems with an idempotent operator, the resulting CSP is not equivalent. 
The complete assignment ((1, 6), (2, b)) which initially had a cost of 1 would 
now have a cost of 2. In order to preserve equivalence, we must "compensate" 
for the induced unary constraint. This can be done by simply subtracting 1 
from all the tuples that contain the value (1,6). The corresponding equivalent 
CSP is shown in figure 1(b): the edge ((1, 6), (2, 6)) of cost 1 has disappeared 
(the associated weight is now 0) while the edge ((1, 6), (2, a)) is unaffected since 
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it has infinite weight. We can repeat this process for variable 2: all extensions 
of value (2, a) have infinite cost. Thus we can add a unary constraint that 
completely forbids value (2, a). In this specific case, and because the valuation 
oo satisfies oo ® oo = oo, we can either compensate for this (Figure 1(c)) or not 
(Figure 1(d)). In both cases, an equivalent Max-CSP is obtained. Between the 
problems in Figure 1(c)) and 1(d), we prefer the problem in Figure 1(d) because 
it makes information explicit both at the domain and constraint level. 

This type of projection mechanism underlies most of the lower bounds de- 
fined for Max-CSP [21, 1, 13, 12]. To our knowledge, the introduction of 
a "compensation" mechanism for preserving equivalence was first introduced 
by [11] on Max-CSP, independently of any notion of arc consistency. The use 
of such mechanism for the definition and establishment of arc consistency ap- 
peared in [18] and in a related form in [10] (for enforcing so-called probabilistic 
arc consistency). 




Figure 2: Two equivalent instances of Max-CSP 

Suppose now that the problem in Figure 1 is part of an instance of Max- 
CSP on four variables, as shown in Figure 2(a). As in crisp CSP, inconsistencies 
can propagate from domains up to constraints. The cost of oo for (2, a) can 
be duplicated in the costs of the pairs ((2, a), (3, a)) and ((2, a), (3, 6)). Since 
£23(6,6) = oo, this in turn implies that the assignment (6,3) inevitably has a 
cost of oo. No further propagation of infinite costs can be performed. 

A similar process can be applied to finite costs but one must take care to 
compensate any cost change. The cost 1 of (1,6) can be first shifted to the 
constraint coi: the costs of the pairs ((0, a), (1, b)) and ((0, b), (1, b)) become 
equal to 1 and the cost of the value (1,6) is set to 0. Since now coi(a, a) = 
coi(a, b) = 1, a cost of 1 can be projected onto value (0, a). Figure 2(b) shows the 
result of such propagations. In the case of finite costs, the process is obviously 
not terminated since one could forever shift this cost back and forth between 
values (0,a) and (1,6). 
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3.1 A new axiom for VCSPs 



To formalise and generalise the ideas presented in the previous section to other 
valuation structures, we have to be able to compensate for the information 
added by projecting weights down onto domains. This is made possible by the 
following additional axiom: 

Definition 3.1 In a valuation structure S = if a, [3 £ E, a 4 [3 

and there exists a valuation 7 6 £ such that a ffi 7 = (3, then 7 is known as a 
difference of (3 and a. 

The valuation structure S is fair if for any pair of valuations a,[3 e E, with 
a =4 (3, there exists a maximal difference of {3 and a. This unique maximal 
difference of (3 and a is denoted by (3 © a. 

Lemma 3.2 Let S — (E,(B,>?=) be a fair valuation structure. Then yu,v,w,E 
E,w =4 v, we have (v © w) =4 v and (u © w) (v w) = {u © v). 

Proof: By definition, (vQ w) w — v. From the monotonicity of ©, this proves 
that (v Qw) =4 v (this inequality becomes strict if © is strictly monotonic and 
ti ^ T). The second property follows from the commutativity and associativity 
of ffi: we have (u © w) © (v w) = u © ((v © w) © w) = (u © v). □ 

Most existing concrete soft constraint frameworks, including all those with 
either an idcmpotcnt or strictly monotonic operator © are fair. 

Example 1 If © is idcmpotcnt, then it can easily be shown that © = max [19]. 
Classical CSPs can be defined as VCSPs over the valuation structure S = 
({_L, T}, max, >), where _L represents true and _L false. The operator ffi is also 
idempotent in possibilistic CSPs [16] which define a min-max problem which is 
dual to the max-min problem of conjunctive fuzzy CSPs [15, 6]. When ffi = max, 
we have © = max, since max(max(a, (3), a) — (3 whenever a =4 [3. When a = (3, 
then any valuation 7 -< a is also a valid difference of [3 and a but it is clearly 
not maximal. 

Example 2 In the strictly monotonic valuation structure (NU{oo}, +, >), © is 
defined by [3Qa — (3 — a for finite valuations a, (3 e N, a < [3 and (00 © a) = 00 
for all a G N U {00}. In the general case of any strictly monotonic operator ffi, 
the difference operator may not exist in E, but it has been proved in [6] that 
the difference operator can always be constructed by embedding the valuation 
structure in a larger valuation structure derived from the set ExE, where ((3, a) 
represents the imaginary [3 © a. This can be compared with embedding R in C 
so as to allow us to take square roots of negative numbers. This construction is 
interesting for lexicographic CSPs [8] for which differences are not always defined 
in the original valuation structure. Another possible approach is to transform 
the lexicographic CSP into a VCSP on the valuation structure (N U {00}, +, >) 
using the simple transformation described in [19]. 

3.2 Equivalence preserving transformations 

As it has been demonstrated in the examples of Figures 1 and 2, it is possible to 
transform a Max-CSP into an equivalent but different Max-CSP using local 
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transformations (involving only one non unary constraint). Such operations will 
be called equivalence-preserving transformations: 

Definition 3.3 The subproblem of a VCSP V = (X,D,C,S) on J C X is 
the VCSP V(J) = (J, Dj, C.j, S), where Dj = {dj : j E J} and Cj = {c P G 
C : PC J}. 

Definition 3.4 For a VCSP V, an equivalence-preserving transformation of 
V on J C X is an operation which transforms the subproblem of V on J into 
an equivalent VCSP. If Cj = {cp G C : P C J} contains only one non unary 
constraint, such an operation is called an equivalence-preserving arc transfor- 
mation. 

Example 3 The procedures Project and Extend described in Algorithm 1 are 
examples of equivalence-preserving transformations. 

Project transform a VCSP by shifting valuations from the tuples of a given 
non unary constraint cp to the value (i,a), where i G P,a G rfj. In order to 
preserve equivalence, any increase at the unary level is compensated at the tuple 
level (line 1 of Algorithm 1). 

Conversely, Extend shifts the valuation from value (i, a) to the tuples of the 
constraint cp where i G P. Again, the fairness of the valuation structure allows 
us to compensate for the possible increase of the tuple valuations by an operation 
at the unary level (line 2 of Algorithm 1). 



Algorithm 1: Two basic equivalence-preserving arc-transformations 
Procedure Project(cp, i, a) 

[3 <- mm tee{P _ {l}) (cp(t, a)); 

c l (a) <— Ci(a) © (3; 

foreach (t G t{P - {i})) do 

1 |_ c P (t,a) <- c P (t,a) e[3; 

Procedure Extend(i, a, cp) 
foreach (t G £(P - {i})) do 
|_ c P (t, a) <— c P (t, a) © Ci(a); 

2 |_ Ci(a) <— c l (a) e Ci(a); 



Theorem 3.5 Given any fair VCSP V = (X, D, C, S), for any c P G C+ , i G P, 
a G di, the application of Project or Extend on V yields an equivalent VCSP. 

Proof: To demonstrate equivalence, it is sufficient to prove that the value of 
cp(t,a) © Ci{a) is an invariant of Project(cp, i, a) and Extend(i, a, cp). For any 
t G £(P — {i}), let 7 be the initial value of cp(t, a) and 8 the initial value of Ci(a). 
After the execution of Project, we have (c P (t, a)©Cj(a)) = (7©/3)ffi(<5©/3) = j®5. 
After the execution of Extend, we have (cp(t,a)(Bci(a)) — (7©5)©(<5©5) = j®6. 
This proves the invariances. □ 

As the example of Figure 2 showed in the case of Max-CSP, the iterated ap- 
plication of equivalence-preserving transformations such as Project and Extend 



8 



does not necessarily lead to a quiescent state. The two following sections show 
how a limited application of carefully designed equivalence-preserving transfor- 
mations can guarantee that a quiescent state will always be reached. 

4 Soft Arc consistency 

In classical CSPs, arc consistency enforcing always increases the information 
available on each variable. In the case of soft arc consistency, application of arc 
transformations will be limited to operations that either increase the informa- 
tion available at the variable level or that increase information available at the 
constraint level as long as they do not lower the information available at the 
variable level. In the next section, we try to better characterise when this is 
possible. 

4.1 On the structure of valuation structures 

Definition 4.1 In a valuation structure (E,®,^=), an element a 6 E is an 
absorbing element iff a © a = a. 

Absorbing elements can be duplicated without affecting valuations. They can 
be propagated, in the same way as inconsistencies are in crisp CSPs. Non- 
absorbing elements a can be shifted from one constraint to another, but each 
addition of a must be compensated by a subtraction elsewhere. 

In a valuation structure (E, ©, >), if © is idempotent then all elements of 
E are absorbing. If © is a strictly monotonic operator then the only absorbing 
elements are _L and T. Intermediate cases occur in the following examples: 

Example 4 Imagine the possible sentences for driving offences. Suppose that 
penalty points (up to a maximum of 12) are awarded for minor offences, whereas 
serious offences are penalised by suspension of the offender's driving license for 
a period of y years, for some positive integer y. A driver who accumulates 12 
penalty points receives an automatic one-year suspension of his/her license. The 
set of sentences can be modelled by a valuation structure S = (E, ffi, of the 
form: 

E = {(p,0) : pe {0,...,12}}U{(0,y) : y G N* U {oo}} 



(p, y) < (p', y') o (y < y') V {{y = y' = 0) A (p < p')) 
(p,0)8(p',0) = (min(p + p',12),0) 

( P ,y)®(p',y') = (o,y + y') if(y + y'^o) 

Note that (12, 0) -< (0, 1) even though they both give rise to a one-year license 
suspension. The penalty (0, 1) is deemed to be worse because it can be cumulated. 
For example (0, 1)©(0, 1) = (0,2), whereas (12,0)0(12,0) = (12,0). Apart from 
_L = (0,0) and T = (0, oo), this valuation structure contains another absorbing 
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valuation, namely (12,0). This is a fair valuation structure since © has the 
following inverse operation ©: 



(p,o)e(p',o) 
(i2,o)e( P ',o) 
(0,y)Q(p',y') 



(p- P ',0) if P < 12 
(12,0) 

(0,y -y') 



Example 5 Another interesting case occurs if, for example, a company wants 
to minimise both financial loss F and loss of human life H if a fire should break 
out in its factory. Supposing that the company considers that no price can be 
put on human life, we must have 



and (F max ,0) is an absorbing element which is strictly less than T. Note that 
this valuation structure is not fair, since it is impossible to define a = (0, 1) 
(i^max.O) such that a © (F max ,0) = (0, 1). 

Example 6 Consider a valuation structure S = (NU{oo, T}, ffi, >) composed of 
prison sentences. Sentences may be of n years, life imprisonment (represented 
by oo) or the death penalty (represented by T). There is a rule that states 
that two life sentences lead automatically to a death sentence: in other words 
(ooffioo) = T. Otherwise, sentences are cumulated in the obvious way: \/m,n G 
N, (m©n = m + n); Vn 6 N, (oo + n = oo); Va 6 E, (Tffia = T). Although every 
pair [3, a £ E, a < (3 possesses a difference, this valuation structure is not fair 
since the set of differences of oo and oo is N and hence no maximal difference 
of oo and oo exists. However, S can easily be rendered fair by replacing N by 
{0, 1,2,..., 150}, for example. 

The following results show that all fair valuation structures are composed of 
slices separated by absorbing values, each slice being independent of the others. 

Lemma 4.2 Let S — (2?,©,^=) be a valuation structure. If a, (3 £ E, a is an 
absorbing element and (3 =4 a then a © [3 = a. If S is fair, then a Q (3 — a. 

Proof: Since (3 ^ a, it follows that a^,a(B(3^,a(Ba — a, by monotonicity. 
Thus, a © (3 = a. Furthermore, a © [3 — a shows that a is a difference of a and 
[3. It is the maximal difference since a © (3 — (a Q (3) © _L =<; (a 9 /?)©/? = a, 
by monotonicity. Thus a © (3 — a. □ 

Lemma 4.3 Let S — (E, ©, be a fair valuation structure. If a, (3 £ E , a is 
an absorbing element and (3 )p a then a © (3 = (3 and (3 © a = [3. 

Proof: Since a is absorbing, (3®a^{(3Qa)®a®a^{(3Qa)®a = (3. 
Furthermore, this shows that [3 is a difference of (3 and a. It is the maximum 
difference since (3 © a =4 (3, by Lemma 3.2. Thus, (3 © a = (3. □ 



(F, H) < (F', H') < H')V {H = H' AF < F') 



If a financial loss of F max represents bankruptcy, then 



(F, H) © (F', H') = (min{F + F 1 , F max }, H + H 1 ) 
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Theorem 4.4 (Slice Independence Theorem) Let S = (E, be a fair 
valuation structure. Let /3, 7 £ £7, /3 =<! 7, and Zet ao,ai G E be absorbing 
valuations such that a =4 7 ^ ct\ . Then a =4 (7 ffi P) =4 a\ and a =4 (7 9 P) =4 
a\. 

Proof: By monotonicity, p ffi 7 ^ a,\ ffi 7 = ai by Lemma 4.2. By Lemma 4.3, 
7 = 7 © a = (7 © /?) © © ct = (7 © P) © «o © P- Therefore, ((7 © P) © a ) is a 
difference of 7 and /3. Since 7©/? is a maximal difference, 7 0/3 >p (7©/?) ffia ^= 
a , by monotonicity. The remaining equalities follow from monotonicity. □ 

The following results will be useful for the proof of correctness of the arc 
consistency enforcing algorithm given in the next section. 

Theorem 4.5 Let S — (E, ffi, be a fair valuation structure. For all a e E, 
aQa is the maximal absorbing valuation less than or equal to a. 

Proof: Let (3 = a © a. Now a ffi ((3 ffi p) = (a ffi (3) ffi (3 = a ffi (3 = a, which 
shows that (3 ffi (3 is a difference of a and a. By definition 3.1, (3 is the maximal 
difference. Therefore, [3 )p (3 ffi (3. Since /3 =^ /3 ffi (3 by monotonicity, we have 
(3 — f3 ffi (3 and hence /3 is absorbing. Maximality follows from Theorem 4.4, 
since for all absorbing valuations o.q ^4 ct, we have ao ^4 (a Q a). □ 

Lemma 4.6 Let S — (E, ffi, >p) be a fair valuation structure. For all a, (3 € E, 

({a ffi /?) © a) © (3 = (a ffi (3) ffi (a ffi /?). 

Proof: Let 7 = (a ffi /3) © (a ffi By Theorem 4.5, 7 is absorbing. Now 

7 =<: (a ffi /?), by Lemma 3.2. Let (5 = ((a ffi p) © a) © /?. Then the fact that 
<5 >p 7 follows from two applications of the Slide Independence Theorem. But 

8 ffi (a p) = (a ffi /?). Therefore <5 is a difference of (a ffi /?) and (a ffi /?). 7 
being the maximal difference, this shows that 6 =4 7 and <5 = 7. □ 

Theorem 4.7 Let £ = (E, ffi, :>=) be a fair valuation structure. For all a,f3 <E E, 
either (a ffi p) © P = a or (a ffi (3) © p = (a ffi p) © (a ffi /?) w/wc/i is absorbing 
and strictly greater than a. 

Proof: Let 7 = (affi/3)©(affi/3). Now (affi/3)©/? = (((affi/3)©/3)©a)ffia = 7©a, 
by Lemma 4.6. Since 7 is absorbing, 7©a equals either a (if a ^ 7, Lemma 4.3) 
or 7 (if 7 a, Lemma 4.2). In this case, the fact that 7 is absorbing follows 
directly from Theorem 4.5. □ 

Theorem 4.8 Any VCSP V = (X, D, C, S) on a fair valuation structure S = 
(E, ffi, >p) is equivalent to a VCSP on a valuation structure S' with no more than 
2ed r + 2 absorbing valuations. 

Proof: For any (3 € E define 

Slice(P) = {ae E : $j absorbing in E s.t. (a ~< 7 =<: (3) V (a y 7 ^ /?)} 

If P is absorbing then Slice(P) = {P} } otherwise Slice(P) is the set of valua- 
tions a for which there is no intermediate absorbing valuation 7 lying between 
a and p. Each Slice(P) contains at most two absorbing valuations, namely the 
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maximum absorbing valuation less than or equal to f3 (which is in fact (3 Q (3, 
by Theorem 4.5) and the minimum absorbing valuation greater than or equal 
to (3 (which may or may not exist). 

Let Eo be the set of valuations taken on by the cost functions cp G C in the 
VCSP and let 

E' = {±,T} {J Slice(j3) 

Clearly E' contains at most 2ed r + 2 absorbing valuations. It is sufficient to 
show that E' is closed under © and 0. 

Consider a, (3 G E' such that a =^ (3 and (3 G Slice{j3 ) for some (3$ G Eq. 

Suppose that (a © (3) ^ E'. This implies that EI7 absorbing in E such that 
a © (3 y 7 y f3o- But, since (3 =^ 7 by the definition of Slice(Po), this contradicts 
Theorem 4.4. Similarly, (3 © a ^ E' implies that EI7 absorbing in E such that 
(3 © a -< 7 =^ /?o- But, since /? ^= 7 by the definition of Slice([3o), this again 
contradicts Theorem 4.4. □ 

By theorem 4.8, we can now assume, without loss of generality, that the 
number of absorbing valuations in the valuation structure is finite. 

4.2 A Definition of Soft Arc Consistency 

Before giving an arc consistency enforcing algorithm which is valid over any fair 
valuation structure, we require a formal definition of arc consistency for fair 
VCSPs. We first consider the usual restriction to binary VCSPs. 

Definition 4.9 A fair binary VCSP is arc consistent if for all i,j G X such 
that Cij G C + , for all a G d, we have: 

1. Vo G d J}Cll (a,b) = (ci(a) ® Cij(a,b) ® Cj(b)) © (cj(a) © Cj(b)) . 

2. Ci(a) = min bed3 (ci(a) © Cj,-(a, b)) 

Condition 1 states that Cij(a, b) has been increased to the maximal element 
in E which does not increase the valuation (cj(a) © Cij(a,b) © Cj(b)) of (a, b) 
on {i,j}- If © is strictly monotonic or idempotent, then this is equivalent to 
saying that absorbing valuations have been propagated from c;(a) to Cij(a,b). 
Condition 2 says that we have propagated as much weight as possible from the 
constraint onto c^. 

To gain a better understanding of condition 1 of Definition 4.9 in the most 
general case, consider a simple valuation structure in which penalties lies in the 
range {0, 1, 2, 3, 4, 5} and Va, [3 G E,(a © (3 = min(5, a + j3)). 5 is absorbing 
and verifies 5 © a = 5 for all a =<; 5. Figure 3(a) shows a 2-variable VCSP over 
this valuation structure. Figure 3(b) shows the result of enforcing condition 1 
of Definition 4.9: 012(0, a) and 012(6,0) can both be increased to 5 without 
changing the valuations of the solutions (a, a) and (6, a). Figure 3(c) shows 
the result of then enforcing condition 2: penalties are projected down from 
constraints to domains, as we have seen in the example of Figure 1. 

Definition 4.9 can be generalised to non binary VCSP. We call this gener- 
alised arc consistency, to be consistent with the terminology employed in the 
CSP literature [14]. 
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Figure 3: (a) An example of a VCSP and how conditions 1 and 2 are enforced 



Definition 4.10 A fair VCSP is generalised arc consistent if for all c P G C + , 
we have: 

1. Vt e £{P),c P (t) = {c P {t) © /?) 9 /?, where (3 = j£P c,(t i{j} ). 

2. Vi G P,Va G di,Ci(a) = mm te£{ p_ {i}) (ci(a) ®c P (t,a)) 

Having given the necessary definitions, we can now define a generalised arc 
consistency enforcing algorithm. 

4.3 Enforcing generalised arc consistency in fair VCSPs 

Arc consistency is established by repeated calls to two subroutines denoted 
by AC-Project and AC-Extend (see Algorithms 2 and 3 respectively), called arc 
consistency operations. The data structure Q is a queue containing elements 
(t, P, a), where a = cp(t). The subroutine AC-Project(cp, i, a) is a simple mod- 
ification of the basic equivalence-preserving transformation Project that mem- 
orises VCSP modifications in the queue for further propagation. This simple 
modification obviously does not alter the fact that it is an equivalence-preserving 
transformation. 



Algorithm 2: Projection for Soft AC enforcing 
Procedure AC-Project(cp, i, a) 

(3 <- mm tee{P _ {l}) (cp(t, a)); 
if (cj(a) © (3 y Cj(o)) then 

Ci(a) <— Ci(a) © /?; 

Add (a,{i},Ci(a)) to Q; 

foreach (t G £(P - {i})) do 
j_ c P (t,a) <- c P (t,a) ©/3; 
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Lemma 4.11 For any fair VCSP V = (X,D,C,S), if c P e C,i £ P,a G d t 
then the result of applying AC-Project(cp, i,a) to a fair VCSP V is an equivalent 
VCSP in which 

d(a) = min (cAa) © cp(t, a)) 
te£(P-{t}) 

Proof: This property follows from the fact that either Ci(a) © is not strictly 
greater than Ci(a) and in this case Ci(a) = Cj(a) © mm te Mp_u\)(cp(t,a)) = 
min te ^(p_{j})(cj(a)©cp(i, a)) or else let £ m ; n be the tuple such that cp(i m i n , a) = 
min t(E £(p_|ji.)(cp(t, a)) = before execution of AC-Project. Let S be the original 
value of a (a). After execution, Cj(a) = 5(B0 = Ci(a) (B cp(t m i n , a) . Therefore we 
have Ci(a) >p min te ^(p_{j})(c,(a) © cp(t,a)). The equality follows from mono- 
tonicity. □ 

The subroutine AC-Extend(z, a, cp) is a modified version of the equivalence- 
preserving transformation Extend that propagates an increase in the valuation 
a(a) to all the valuations cp(t, a) for t £ £(P—{i}) when this can be done with- 
out any compensation at the unary level. It also memorises the new valuation 
7 of each tuple of cp in Q for further propagation. In this case, 7 is always an 
absorbing valuation (by Theorem 4.7). 



Algorithm 3: Extension for Soft AC enforcing 
Procedure AC-Extend(z, a, cp) 
foreach (t G £{P - {i})) do 

7^ (c P (t,a)®0)e0; 
if (7 >- cp(t,a)) then 
c P (t,a) <- 7; 
_ Add ((*, a), P, c P (t, a)) to Q; 



Lemma 4.12 For any fair VCSP V = (X,D,C,S), if c P G C,i G P,a G di 
then the result of applying AC-Extend(i, a, cp) to a fair VCSP V is an equivalent 
VCSP in which 

Vt G £{P - {i}), (c P (t, a) = {c P {t, a) © 0) /?), w/iere /3 = Cj ({t, a) l{j} ) 

jeP 

Proof: To demonstrate equivalence, it is sufficient to prove that Vf £ £(P — {«}), 
0®cp(t,a) is an invariant of AC-Extend(i, a, cp), where /? = J(E p Cj((t, a)j.{j})- 
But this is certainly the case because, if cp(t,a) — a before execution of AC- 
Extend(i, a, c P ), then © c P (t, a) = © ((a © 0) © /3) = /3 © a after c P (t, a) is 
updated by AC-Extend(«, a, cp). 

We know that a =<; (a © 0) © /?, since a is clearly a difference of a © /3 and /3. 
If a -< (a © 0) © /3, then cp(t, a) is assigned (a © 0) © /?. Hence, after cp(t, a) 
is updated by AC-Extend(i, a, cp), /3 © cp(i, a) = /3 © a and (cp(f, a)®0)Q0 = 
(a®0)e0 = c P (t,a). □ 

We are now in a position to give an algorithm (Algorithm 4) for generalised 
arc consistency in fair VCSPs. 
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Algorithm 4: Generalised Arc Consistency enforcing for fair VCSPs 
Procedure GAC() 

{ Initialisation phase }; 
foreach i G X do 
foreach a e di do 

foreach cp 6 C + s.t. iePdo 
AC-Extend(z, a, cp); 
AC-Project(cp, i, a); 

{ Propagation phase }; 
while Q ^ do 

Extract the first element (t, P, a) from Q; 
if cp(t) = a then 

if P is a singleton {i} then 
j foreach cp G C + s.t. i E P do AC-Extend(i, t^, cp); 

else 

j foreach iePdo AC-Project(cp, i, 



Theorem 4.13 When GAC terminates, the resulting VCSP is generalised arc 
consistent. 

Proof: Consider (cp,i,a) such that cp G C, i € P,a e di. We know that 
AC-Project(cp, i, a) is called at least once during GAC, since it is called in the 
initialisation phase. After the last call to AC-Project(cp, i, a) 

Cs(a) = min (cAa) © cp(t.a)) 

t£t{P-{i}) 

by Lemma 4.11. This can only later become invalid by an increase in some 
cp(t) by AC-Extend, which would necessarily be accompanied by the addition of 
(t, P, cp(t)) to Q and would hence entail another call of AC-Project(cp, i, a). This 
contradiction demonstrates that Condition 2 in Definition 4.10 of generalised arc 
consistency holds when GAC terminates. 

Consider t <G £(P) where cp e C + . We know that AC-Extend(i, t^y, cp) is 
called during the initialisation phase for each i G P. After the last such call of 
AC-Extend(i, t^y, c P ) for any i G P, 

Vi G £(P), c P (t) = (c P (t) © P) 9 0, where (3 = Cj(t i{j} ) 

by Lemma 4.12. This could only later become invalid by an update of cp(t) or 
some Cj(ttfj\) by AC-Project(cjv,j, taj\) for some cjv € C such that j G P fl N. 
But then a call of AC-Extend(j, t^jj,c P ) would ensue. This contradiction shows 
that Condition 2 of Definition 4.10 of generalised arc consistency also holds 
when GAC terminates. □ 

Theorem 4.14 GAC has polynomial time complexity. 
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Proof: Let n\ be the number of elements (t, P, a) extracted from Q during 
GAC such that P is a singleton, and let n 2 be the number of elements (t, P, a) 
extracted from Q during GAC such that \P\ > 2. By Theorem 4.8, we can assume 
that the valuation structure contains at most 2ed r + 2 absorbing valuations. 

Let cp E C + and t 6 £(P)- By Theorem 4.7, AC-Extend can only increase 
cp(t) to an absorbing valuation strictly greater than its previous valuation. AC- 
Project can decrease cp(t) but, by the Slice Independence Theorem, only from 
a non-absorbing valuation 7 to a valuation larger than or equal to 5 = 7 7, 
the maximal absorbing valuation less than or equal to 7. Thus the sequence of 
absorbing valuations taken on by cp(t) during GAC are strictly increasing. Thus 
for each of the 2ed r + 2 attainable absorbing valuations a, (i, P, a) is added to 
Q at most once. Thus n 2 < ed r (2ed r + 2). 

Now n\ cannot exceed the number of calls of AC-Project during GAC since 
tuples (t, P, a) such that P is a singleton are only added to Q by AC-Project. 
The number of calls of AC-Project is clearly bounded above by erd + n 2 r. Thus 
n\ + ri2 < erd + (r + l)n 2 = 0(e 2 d 2r ). Thus the total number of iterations of 
the while loop in GAC is a polynomial function of e and d. The results follows 
immediately. □ 



Definition 4.15 An arc consistent closure of a VCSP V is a VCSP which 
is arc consistent and which can be obtained from V by a finite sequence of 
applications of arc consistency operations AC-Extend and AC-Project. 

Note that confluence of arc consistency enforcing is lost and therefore the arc 
consistent closure of a problem is not necessarily unique as it is in classical CSPs. 
Figure 4(a) shows a 2-variable VCSP on the valuation structure (NU{oo}, +, >}. 
Each edge has a weight of 1. Figures 4(b) and 4(c) show two different arc 
consistency closures of this VCSP. 




Figure 4: A Max-CSP and two different equivalent arc consistent closures 



4.4 Maximum arc consistency 

One of the practical use of arc consistency in VCSP is the computation of lower 
bounds on the valuation of an optimal solution. Obviously, given a VCSP V, the 
following valuation / m ; n (V) is always a lower bound on the cost of an optimal 
solution: 

/nun(V0= 0[min C P (t)} 
c P ec 
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i(u,l) 



i(u,2) 



i(u,m(u)) i(^u,m(u)) 





Figure 5: The gadget G(u) representing the m u occurrences of u and the m u 
occurrences of -iu in I3-SAT 



From this point of view, the closure in 4(b) is preferable to the closure in 
Figure 4(c) since it makes explicit the fact that 1 is a lower bound on the 
valuation of all solutions. 

Definition 4.16 A VCSP V is said to be maximally arc consistent if it is arc 
consistent and if the associated lower bound f m i n {V) is maximum over all arc 
consistent closures of V . 

The problem of enforcing maximal arc consistency is certainly practically 
important and some closely related problems are known to be NP-hard [17, 19]. 
Consider the following problem: 

Problem 1 (Max-AC) Given a VCSP V = (X, D, C, S) and a valuation k e 
S, does there exist an arc consistency closure V' ofV such that f m \.n{V) >p k ? 

Theorem 4.17 The decision problem Max-AC is NP-complete. 

Proof: Max-AC is clearly in NP. It is therefore sufficient to give a polynomial 
reduction from 3-Sat to Max-AC. 

Let I3-SAT be an instance of 3-Sat, consisting of n variables and d clauses, 
each clause being the disjunction of exactly 3 literals. 

We assume that each boolean variable u and its negation occur exactly 
the same number of times in Issat- Note that if this is not initially the case, 
it can easily be achieved by adding the required number of tautological clauses 
of the form (mVmV -iu) or (u V -<u V ->u). We will now construct an instance 
V of Max-CSP on Ad variables such that V has an arc consistency closure V 
with f min (V) ^ f iff ^3-Sat is satisfiablc. Note that d is necessarily even by 
our assumption that each variable u and its negation occur the same number of 
times. 

Suppose that the boolean variable u (and its negation ->u) occur in exactly 
m(u) clauses in 73-sat- Then we add the gadget G{u) shown in Figure 5 to 
V, containing the 2m(u) variables i(u,r), i(->u,r) (r = 1, . . . , m(u)), each with 
domain-size 3. Each edge joining value a at variable i and value b at variable j 
represents a penalty of 1, i.e. Cij(a,b) = 1. For each clause c in /3-SAT, we add 
the gadget H(c) shown in Figure 6, involving a new variable i(c) connected to 
three existing variables. In the example shown, c = (uVvV-w) where c contains 
the p th occurrence of the boolean variable u in /3_sat, the q th occurrence of v 
and the r th occurrence of ->w. In the gadget H{c) shown in Figure 6, i(c) is 
connected to i(-m,p), i(-iv,q) and i(w,r). 



17 



Figure 6: The gadget H(c) for c = (u V v V -iw). 



Let Mi = maxagdi (4( a ))' where c' represents the constraint functions in 
V. Each variable i(c) can contribute at most 1 to f m in(V), i.e. < 1. By 

construction of G(u), if any variable (e.g. r)) contributes 1 to f m m(V), then 
its adjacent variables (i(-iu,r — 1) and i(-iu,r)) cannot contribute to f m m(V). 
This means that the maximum value of f m i n (V) is d + 4j = 4j, since the total 
number of variables in the gadgets G(u) is 3d. Indeed, / min (F') = f iff for all 
clauses c, Mj( c ) = 1 and for all boolean variables u, 

(Vr G {1, . . . , m(u)}, M i(Uir) = 1 A M i( ^ u , r) - 0) V 

(Vr G {1, . . . , m(u)}, M i( ^ u>r) = 1 A M i(tlir) - 0) (1) 

Consider the clause c = (uVvV-no), whose gadget £f( c ) is shown in Figure 6. 
By construction of i?(c), = 1 implies that 

(M l( ^ p) = 0) V (M i( ^ i9) - 0) V (M i(lUir) = 0) 
which, in turn, implies from (1), that 

(M i(Uil) = 1) V (M i(Vil) - 1) V (M i(l0i i) - 0) (2) 

Suppose that V has an arc consistency closure V with f m \ n (V) ^= 4j. For 
each variable u in /3-SAT, set u = true iff Mu u> -\\ = 1. For each clause c, for 
example c = (iiVuV ~<w), we know from (2) that either u = true, v = true or 
w = false. Hence /3-sat is satisfied. 

Suppose that ui is a model of /3-sat- In each gadget G(u) in V and for each 
r G {1, . . . , m(u)}, if u = true in u> then project penalties onto i(u, r) from its 
constraints with the adjacent variables i{-^u, r — 1) and i(->w, r); if u = /a/se in 
w, then project penalties onto i(-<u, r) from its constraints with the adjacent 
variables i(u, r) and i(u, r + 1). Consider a gadget H(c) in V, such as the 
gadget illustrated in Figure 6 for c = (iiVuV -w). If w = true in w, then 
project penalties onto i(c) from its constraint with i{->u,p)\ if it = /afee in lo, 
then project penalties onto i(-iu,p) from its constraint with i(c). Similarly, 
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if ->w = true in u>, then project penalties onto i(c) from its constraint with 
i(w, r); if -<w — false in ui, then project penalties onto i(w, r) from its constraint 
with i(c). Let V be the resulting arc consistent VCSP. Since each clause is 
satisfied by lu, Mj( c ) = 1. Furthermore, if u = true in u), then M^ u r ^ = 1 for 
r G {1, . . . , m(w)} and if m = /afee in w, then Mj(-,„ )T .) = 1 for r G {1, . . . , m(u)}. 

Thus/ min (y') = rf+f = ¥• □ 



4.5 The case of strictly monotonic VCSPs 

For strictly monotonic VCSPs, the previous algorithm can be improved using 
an alternative equivalent definition of arc consistency based on the notion of the 
underlying CSP. 

Definition 4.18 The underlying CSP of a VCSP V has the same variables 
and domains as V together with, for each constraint cp G C, a crisp constraint 
c! p satisfying Vf G £(P)(t G c' p ^ Cp(t) -< T) (i.e., t is not a totally forbidden 
labelling). 

In strictly monotonic VCSPs, the only absorbing elements are T and _L. 
This allows us to give an equivalent but simpler definition of generalised arc 
consistency: 

Theorem 4.19 If ® is a strictly monotonic operator, then a VCSP is gener- 
alised arc consistent iff: 

1. its underlying CSP is generalised arc consistent 

2. yc P G C+,Vi G P,Va G <k, if 'Ci(a) -< T then 3t G l{P-{i}){c P {t,a) = _L). 

Proof: (=>) Suppose that a strictly monotonic VCSP is generalised arc con- 
sistent but its underlying CSP is not. Then 3cp G C, i G P, a G di such that 
(d(a) -< T) A (Vt G £(P - {i})(c P (t,a) = T V 3 j e P - {Ofefe}) = T))). 
But, by Condition 1 of Definition 4.10, (cj(t^fj) = T) implies cp(t,a) = T. 
Hence, Ci(a) = T, by Condition 2 of Definition 4.10, which is a contradiction. 
Suppose on the other hand that the VCSP is generalised arc consistent but 
Condition 2 of Theorem 4.19 is not satisfied. Then 3cp G C + ,i G P,a G di 
such that a(a) -< T and Vt G £(P - {i}), (c P (t, a) y _L). But by Condition 2 of 
Definition 4.10, for some t G £(P — {i}), Ci{a) — c,(a) ©cp(t, a) >- Ci{a) by strict 
monotonicity, which is impossible. 

(<=) Suppose that a strictly monotonic VCSP satisfies Condition 1 and 2 
of Theorem 4.19. Condition 2 clearly implies Condition 2 of Definition 4.10. 
Suppose that Condition 1 of Definition 4.10 is not satisfied. Then 3cp G C, t G 
t(P) such that c P (t) ^ 5 = (c p (t) © (3) Q [3 where (3 = jeP Cj(t l{j} ). By 
Theorem 4.7, 5 is absorbing, which is only possible if Cj(tuj\) = T for some 
j G P. But the generalised arc consistency of the underlying CSP implies 
Cp(t) = T, which provides the necessary contradiction. □ 

A possible way to enforce soft arc consistency on a strictly monotonic VCSP 
is therefore to first enforce classical arc consistency on the underlying CSP, 
assign a valuation of T to all deleted values in the original VCSP and then 



19 



Algorithm 5: Enforcing soft arc consistency on strictly monotonic VCSPs 
Enforce arc consistency in the underlying CSP; 
foreach cp G C + do 
foreach i G P do 

j_ foreach a G do Project(cp, i, a); 



enforce the second property by applying Project(cp, i, a) once for all cp G C + , 
all i £ P and all a £ di (see Algorithm 5). 

The only additional result needed to prove that this algorithm works is the 
following one: 

Theorem 4.20 Let V be a strictly monotonic VCSP whose underlying CSP 
is arc consistent. Then, Vcp G C + ,Vi G P, Va G d i; the application of the 
equivalence-preserving transformation Project(cp,i,a) yields a VCSP whose un- 
derlying CSP is unchanged (and therefore arc consistent). 

Proof: Project(cp, i, a) cannot increase a valuation Ci(a) ^ T to T since arc 
consistency on the underlying CSP would have deleted (i,a) in this case and 
therefore we would have set Ci(a) = T. It cannot decrease the valuation of any 
tuple such that c P (t, a) = T since V/3 G E, T e (3 = T. □ 

4.5.1 Improving space complexity 

If an optimal 0(ed r ) arc consistency enforcing algorithm such as generalised 
AC7 [2] is used to enforce arc consistency on the underlying CSP of a fair 
VCSP, Algorithm 5 establishes arc consistency in 0(ed r ) too. However, the 
space complexity of this algorithm is dominated by the space complexity of 
the modified constraints which requires 0(ed r ) valuations. This is extremely 
expensive, especially for constraints defined using a cost function. This space 
requirement can be reduced using a simple data structure for representing mod- 
ifications of costs induced by basic equivalence-preserving transformations such 
as Project and Extend. 

Let us denote by c°p G C the original definition of a constraint in a fair 
VCSP by any possible way: explicitly by a table of valuations or implicitly by 
a cost function from t(P) — > E. For each constraint cp, for each variable i G P, 
we use 2 tables of d valuations noted Ap- and Ap i; initialised to J_. Let aed,: 

• Apja] contains the combination of all the valuations that are projected 
from cp onto (i,a); 

• Apja] contains the aggregation of all the valuations that are extended 
from (i, a) to cp. 

At any time, the valuation of a tuple t G £(P) in the modified constraint cp can 
simply be obtained by : 

c P (t) = c° P r (t) © (0 A+ [t L{i} ]) e (0 A p jt iW D 
ieP ieP 
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By definition of projection, (0 l£P A Pl [t l{l} }) =^ (c° p r (t) © (0 l£P A+ [t l{i} ])) 
and the difference always exists in a fair VCSP. The space complexity is now 
reduced to O(edr) instead of 0(ed r ) and our two basic equivalence-preserving 
transformations Project and Extend become space tractable even for large arity 
constraints defined using cost functions. 



Algorithm 6: Projection and Extension for Soft AC enforcing 
Procedure Project(cy i, a) 

a(a) <— a(a) © a; 
_ Apja] <- A Pl [a] © a; 

Procedure Extend(z, a, cp) 

a <— Cj(a); 

A+ [a] ^ A+ [a] ©a; 
_ Ci(a) <— Ci(a) © a; 



Algorithm 6 describes the procedures that implement these transformations 
with these data structures. The time complexity of Extend is reduced to O(l) 
but since computing cp(t) requires 0(r) ffi operations, Project is 0(rd r_1 ) in- 
stead of 0(d r ^ 1 ). This makes generalised arc consistency enforcing on strictly 
monotonic VCSPs 0(red r ) in time. For binary constraints, we recover the usual 
0(ed 2 ) time and 0(ed) space complexities for arc consistency enforcing. 

5 Directional arc consistency 

In CSPs, directional arc consistency is a weak version of arc consistency. In 
VCSPs, the order imposed on variables by directional arc consistency (first 
defined in [6] for strictly monotonic operators) makes it possible to use the 
unlimited version of Extend (instead of AC-Extend) together with a terminating 
algorithm. For this reason, soft directional arc consistency may be stronger than 
arc consistency. 



a b a fi a b a b 




a b a " b a " b a " b 



Figure 7: Enforcing directional arc consistency 

Consider the Max-CSP in figure 7(a). It includes one binary constraint 
that forbids pair ((1, 6) (2, b)) and two unary constraints that forbid values (1, a) 
and (2, a). This VCSP is already arc consistent and the corresponding lower 
bound / m in(V") is equal to 0. However, we can apply Extend on value (l,a), 
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getting the equivalent VCSP 7(b) which is not arc consistent. We can then 
apply Project on value (2, b) and obtain the CSP 7(c) with a corresponding 
lower bound f m in(V) = 1. 

This improved lower bound has been obtained because we have decided 
to pool all the unary valuations on one of the variables. This can be done 
successively on all variables using any given variable order. In the context 
of branch and bound (or other tree-based search), weights can for example 
be propagated towards those variables which occur earlier in the instantiation 
order. 

Definition 5.1 A binary VCSP is directional arc consistent according to an 
order < on variables i/Vcjj G C + such that i < j, Va G di 

Ci{a) = min(cj(a) © Cij(a, b) © Cj(b)) 

bedj 

Provided that the VCSP is fair, directional arc consistency can be established 
in polynomial time by the procedure DAC in Algorithm 7, where Project and 
Extend are as given in Algorithm 6. 



Algorithm 7: Enforcing directional arc consistency on fair binary VCSPs 
Procedure DAC() 

for (i <— (n — 1) downto 1) do 

foreach {j G X s.t. j > i and G C) do 
{Start of propagation of c^ }; 
foreach (b G dj) do Extend(j, b, cy); 
foreach (a G di) do Project(cy , i, a); 
{End of propagation of c^ }; 
l {Assert A(i,j) : Va G di,Ci(a) = mm bedj (c;(a) © Cy(a, b) © 



Since DAC only applies equivalence-preserving transformations, it yields an 
equivalent VCSP. The following lemma is needed to prove that the VCSP ob- 
tained is directional arc consistent. 

Lemma 5.2 If® is fair, then 

(a = a © fi © 7) A {a' >? a) A (7' =^ 7) => (a' = a' © (3 © 7') 

Proof: Suppose that (a = a © (3 © 7) A (a' ^ a) A (7' =^ 7). Then a' 4 

a' © (3 © 7' =^ a' © f3 © 7 ^ (a' © a) © (a © (3 © 7) = (a' © a) © a = a'. It follows 
that a' = a' © /3 © 7'. □ 

Theorem 5.3 If the binary VCSP is fair, then directional arc consistency can 
be established in 0(ed 2 ) time and 0(ed) space complexity. 

Proof: The assertion A(i, j) is clearly true during execution of DAC at line 1 
of Algorithm 7 when constraint has just been propagated. 

It suffices to show that A(i,j) cannot be invalidated by later propagations 
of constraints Ci>j> where i' < j' and (i' < i) V (i' = i A j ^ j 1 ). Such operations 
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may increase Ci{a) and may decrease Cj(b) but cannot modify Cij(a,b). From 
Lemma 5.2, Ci(a) = Ci(a) © Cij(a,b) © cj(b) remains true and hence assertion 
A(i, j) cannot be invalidated by later propagations and DAC yields a directional 
arc consistent VCSP. 

As for time complexity, procedures Extend and Project are called O(ed) times 
and are both 0(d) for binary VCSP. DAC is therefore 0(ed 2 ) in time. The 
0(ed) space complexity can be attained using the implementations of Project 
and Extend presented in Algorithm 6. □ 

When restricted to strictly monotonic VCSP, Theorem 5.3 can be related 
to the result, proved in [6], that full directional arc consistency, a stronger 
version of directional arc consistency, can be established in 0(ed 2 ) time and 
space complexity. A VCSP is full directional arc consistent if and only if it is 
simultaneously arc consistent and directional arc consistent. 

Theorem 5.4 Suppose that the constraint graph of a binary fair VCSP V is 
a tree T and that V is directional arc consistent according to some topological 
ordering of the tree (i is the father of j in T (i < j)). Then, for all a G d\, 
Ci(a) is the optimal valuation over all solutions to V in which variable 1 is 
assigned value a <G d\ . 

Proof: Let S be the set of all the sons of variable 1 in T and for each j e S, 
let Tj be the set of all variables in the subtree rooted in j. By induction, we 
assume that Vj G S, V& e dj , the valuation Cj (b) is the optimal valuation over all 
solutions to the subproblem on Tj . Let %j be one corresponding optimal tuple 
over Tj. 

Let a G d\ and for each j G S, let bj a be a value in dj that minimises 
c\(a) © cij(a,bj a ) © Cj(bj a ). Since Vi, j eS,i/ j, Ti n Tj = 0, we can build a 
tuple t over X by concatenation of each tb ja j for all j G S and by assigning value 
a to variable 1. The valuation of the tuple t, is Vy(t) = c\(a) ® Q)j e s( c j(bja) © 
c\j(a, bj a )) = Ci(a) since the VCSP is directional arc consistent. 

Suppose there exists t' such that t^u = a and VV(t') -< VV(t). Since the 
problem is tree-structured, the valuation of t' can be written as 

Vv(t') = ci(a) © je <?(cij(a,ij {j} ) © V v{Tj ){t'^.)) (tree structure) 

> ci (a) © ie5 (cij (a, t'^y ) © (£[{_,•})) (induction, monotonicity) 

> ci(a) © Q)j eS (cj(bja) © cy(a, 6,- a )j (definition of b ja ) 
= Cl (a) = V v (t) 

which shows that no such t' exists. □ 



6 Arc irreducibility 

We have seen that the cost of generalising arc consistency from crisp to valued 
constraint satisfaction problems is the loss of uniqueness of the arc consistent 
closure. As Figure 4 showed, two different arc consistent closures may also 
induce different lower bounds via / m i n - 

If a VCSP V is equivalent to another VCSP V which is better than V 
(according to some formally defined criterion C) then we say that V is reducible 
for this criterion. Reducing a VCSP to an equivalent irreducible problem is, in 
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general, an NP-hard problem. To see this, consider a CSP. If it is inconsistent 
(i.e., has no solution), then its best equivalent problem, for any reasonable 
criterion C, is a CSP in which this fact is made explicit, for example, by having 
Va G di, Ci(a) = T for some variable i G X. Since testing consistency of a CSP 
is an NP-complete problem, we can deduce that testing global irreducibility is 
NP-hard. 

Fortunately, irreducibility has local versions which arc analogous to local 
consistency. For example, a binary VCSP V is arc-irreducible if, for all pairs 
of variables i, j eX,V cannot be improved by replacing Ci,Cj,Cij by an equiv- 
alent set of constraints c^, c'j, c^ . However, before giving a formal definition of 
arc-irreducibility, we have to consider which criteria we could use to compare 
equivalent VCSPs. 

Definition 6.1 A problem evaluation function / is a function which, for each 
VCSP V , assigns a value to V in a totally ordered range. When comparing 
two equivalent VCSPs, V\ and V2, V\ is considered as a better expression of the 
problem if f(V 1 )> f{V 2 ). 

Example 7 The function / m i n previously defined as 

funn(V)= (min (c P (t))) 

c P ec 

is a problem evaluation function. 

The main result presented in this section concerns / m i n , but the definitions 
are valid for any problem evaluation function /. 

Definition 6.2 A binary VCSPV is arc-irreducible with respect to the problem 
evaluation function f (or (2, /) -irreducible), z/VJ C X, \J\ = 2, for all VCSP 
V derived from V by an equivalence-preserving transformation on J, f(V) > 

f(V). 

Note that for certain choices of the problem evaluation function /, an arc- 
irreducible VCSP is not necessarily arc-consistent. For example, if Vi,j G 
X, 3a G di,b G dj such that Ci(a) = cj(b) — Cij(a,b) = _L, then the VCSP 
is (2, / m ; n )-irreducible but it is not necessarily arc-consistent. Conversely, the 
VCSP in Figure 4(c) is arc consistent, but not (2, / m ; n )-irreduciblc. The follow- 
ing theorem shows that there is an important relationship between directional 
arc consistency and (2, / m i n )-irreducibility. 

Theorem 6.3 A fair binary VCSP V = (X,D,C,S) which is directional arc 
consistent is (2, / m i n ) -irreducible. 

Proof: Suppose that V is directional arc consistent and let i,j € X be such 
that i < j. Then, by definition, Va G di, 3b G dj such that 

Ci(a) = min(cj(a) © Cij(a, b) © Cj(b)) 

Thus the minimum valuation of a solution to the subproblem of V on {i, j} is 

min(cj(a)) 

aedi 
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Suppose that this minimum is attained for a = u 6 di and that v G dj is such 
that 

Cj(u) = (cj(u) Cij(u,v) © Cj(v)) (3) 

Now consider a VCSP V obtained by an equivalence-preserving transformation 
of V on {i, j} which replaces a, Cj,dj by c-, c'pC 1 ^. Then 

/nnn(O=(/min(V0e( fec P (i)]))®( l^p(t)]) 
PC{i,j} PC{i,j} 

since V and V' only differ on Thus 

/min(V") (/min(^) © <*(«)) © (c£(u) © C^(u,«) © cj(w)) 

(/min(V) © (Ci(tt) © Cy(u, w) © Cj(v))) © (c{(«) © C^(u, w) © c£(v)) 

by equation 3. Thus / m i n (V) f m in(V) due to the equivalence of the subprob- 
lems of V and V on {i, j}. Thus, V is (2, / m ; n )-irreduciblc. □ 

This result must be considered with care. Given any VCSP V, Theo- 
rem 6.3. states that any directional arc consistent closure Vdac of V is always 
(2, / m in)-irreducible. However, an arc consistent closure V ac may exist such that 

/min(Vac) f~ /min(V^ ac ). 

Corollary 6.4 Arc-irreducibility with respect to / m ; n can be established in 
0{ed 2 ) time complexity and 0(ed) space complexity on fair binary VCSPs. 

Proof: This follows directly from Theorems 5.3 and 6.3. □ 



Conclusion 

The concept of arc consistency plays an essential role in constraint satisfaction 
as a problem simplification operation and as a tree-pruning technique during 
search through the detection of local inconsistencies among the uninstantiated 
variables. We have shown that it is possible to generalise arc consistency to any 
instance of the valued CSP framework provided the operator for aggregating 
penalties has an inverse. 

A polynomial-time algorithm for establishing soft arc consistency exists. Its 
space and time complexity is identical to that of establishing arc consistency 
in CSPs whenever the aggregation operator of the VCSP is strictly monotonic, 
which is the case in Max-CSP, for example. Contrarily to classical CSP arc 
consistency, it does not define a unique arc consistency closure. This algorithm 
nevertheless provides an efficient technique for generating lower bounds on the 
value of a solution which can be used during branch-and-bound search as in [13, 
12]. The problem of finding the maximal lower bound is however NP-hard. 

We have also defined a directional version of soft arc consistency which is 
potentially stronger since it allows non-local propagation of penalties. Direc- 
tional soft arc consistency implies a form of local optimality in the expression of 
the VCSP, called arc irreducibility. Furthermore, the complexity of establishing 
directional arc consistency is identical to that of establishing arc consistency in 
CSPs. 
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